Please wait a minute...
JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE)
    
Calibration and 3D reconstruction with omnidirectional ranging by optic flow camera
MA Zi ang, XIANG Zhi yu
Department of Information Science and Electronic Engineer, Zhejiang University, Hangzhou 310027, China;Zhejiang Provincial Key Laboratory of Information Network Technology, Zhejiang Province, Hangzhou 310027, China
Download:   PDF(2036KB) HTML
Export: BibTeX | EndNote (RIS)      

Abstract  

There are limitations when applying active sensing in designing guidance systems for UAVs, which can be bulky and expensive. An omnidirectional ranging by optic flow camera was introduced, which was composed of a traditional perspective camera and a reflective mirror with certain imaging characteristic. The imaging characteristic helped establish a simple relationship between the distance from space point to the optical axis of  camera and the value of optic flow. Thus, 3D reconstruction of test scene could be realized directly. As a result, the ranging accuracy of the system is mainly influenced by the angular error of installation through simulation experiments. Therefore, a new parameters calibration method was proposed to assist in improving ranging accuracy. Results show that 3D reconstruction can be achieved by exploiting the designed camera to the stereo scene. The experimental results demonstrate the effectiveness of the proposed calibration and reconstruction method.



Published: 15 October 2015
CLC:  TP 242.6  
Cite this article:

MA Zi ang, XIANG Zhi yu. Calibration and 3D reconstruction with omnidirectional ranging by optic flow camera. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(9): 1651-1657.

URL:

http://www.zjujournals.com/eng/10.3785/j.issn.1008 973X.2015.09.006     OR     http://www.zjujournals.com/eng/Y2015/V49/I9/1651


光流测距全向相机的标定与三维重构

针对基于主动式传感器的无人驾驶飞机导航系统在实际应用中存在的体积庞大、成本高等问题,介绍一种由传统透视相机和具有等距性的反射镜面组成的相机镜面系统. 镜面的等距性使得空间点到相机光轴的轴心距与图像光流值之间存在一种简单的对应关系,使用该相机镜面系统可以直接对场景进行测距. 通过仿真实验发现,系统测距精度主要受镜面与相机的角度安装误差的影响. 提出一种新的参数标定方法来改善测距精度. 结果表明:将相机应用于实际场景,可以较好地实现环境的三维重构,证明所提出的标定与重构方法的有效性.

[1] SRINIVASAN M V. A new class of mirrors for wide angle imaging [C] ∥ Computer Vision and Pattern Recognition Workshop. Madison: IEEE, 2003, 7: 85.
[2] FERNANDO C G, MUNASINGHE R, CHITTOORU J. Catadioptric vision systems: survey [C] ∥ System Theory. Piscataway: IEEE, 2005: 443-446.
[3] COLOMBO A, MATTEUCCI M, SORRENTI D G. On the calibration of non single viewpoint catadioptric sensors [M] ∥ RoboCup 2006: Robot Soccer World Cup X. Berlin:Springer, 2007: 194-205.
[4] MASHITA T, YACHIDA M. Calibration method for misaligned catadioptric camera [J]. IEICE Transactions on Information and Systems, 2006, 89(7): 1984-1993.
[5] FABRIZIO J, TAREL J P, BENOSMAN R. Calibration of panoramic catadioptric sensors made easier [C] ∥ Omnidirectional Vision. Copenhagen: IEEE, 2002: 45-52.
[6] MOREL O, FOFI D. Calibration of catadioptric sensors by polarization imaging [C] ∥ Robotics and Automation. Beijing: IEEE, 2007: 3939-3944.
[7] DERRIEN S, KONOLIGE K. Approximating a single viewpoint in panoramic imaging devices [C] ∥ Robotics and Automation. San Francisco: IEEE, 2000:3931-3938.
[8] BRASSART E, DELAHOCHE L, CAUCHOIS C, et al. Experimental results got with the omnidirectional vision sensor: SYCLOP [C] ∥ Omnidirectional Vision. South Carolina: IEEE, 2000: 145-152.
[9] CHAHL J S, SRINIVASAN M V. Reflective surfaces for panoramic imaging [J]. Applied Optics, 1997, 36(31): 8275-8285.
[10] SRINIVASAN M V, THURROWGOOD S, SOCCOL D. An optical system for guidance of terrain following in UAVs [C] ∥ Video and Signal Based Surveillance. Sydney: IEEE, 2006: 51.
[11] SOCCOL D, THURROWGOOD S, SRINIVASAN M V. A vision system for optic flow based guidance of UAVs [C] ∥ Proceedings of the Australasian Conference on Robotics and Automation. Brisbane: ACRA, 2007.
[12] INGARD K U. Fundamentals of waves and oscillations [M]. Cambridge: Cambridge University Press, 1988.
[13] LUCAS B D, KANADE T. An iterative image registration technique with an application to stereo vision [C] ∥ International Joint Conference on Artificial Intelligence. Vancouver: IJCAI, 1981, 81: 674679.
[14] BOUGUET J Y. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm [J]. Intel Corporation, 2001, 5: 1-10.
[15] CANNY J. A computational approach to edge detection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence. 1986, (6): 679-698.
[16] FISCHLER M A, BOLLES R C. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography [J]. Communications of the ACM, 1981, 24(6): 381-395.

[1] JIA Song min, LU Ying bin, WANG Li jia, LI Xiu zhi, XU Tao. Mobile robot human tracking using hierarchical features[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(9): 1677-1683.
[2] JIANG Wen ting, GONG Xiao jin, LIU Ji lin. Incremental large scale dense semantic mapping[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2016, 50(2): 385-391.
[3] WANG Li-jun, HUANG Zhong-chao, ZHAO Yu-qian. New spatial-coherent latent topic model based on super-pixel segmentation and scene classification method[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 402-408.
[4] CAO Teng, XIANG Zhi-yu, LIU Ji-lin. Obstacle detection based on V-intercept in disparity space[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2015, 49(3): 409-414.
[5] LU Wei, XIANG Zhi-yu, YU Hai-bin, LIU Ji-lin. Object compressive tracking based on adaptive multi-feature appearance model[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(12): 2132-2138.
[6] CHEN Ming-ya, XIANG Zhi-yu, LIU Ji-lin. Assistance localization method for mobile robot based on
monocular natural visual landmarks
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2014, 48(2): 285-291.
[7] LIN Ying, GONG Xiao-jin, LIU Ji-lin. Calibration of fisheye cameras based on the viewing sphere[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2013, 47(8): 1500-1507.
[8] WANG Hui-fang, ZHU Shi-qiang, WU Wen-xiang. Improved adaptive robust control of servo system with harmonic drive[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(10): 1757-1763.
[9] OUYANG Liu, XU Jin, GONG Xiao-jin, LIU Ji-lin. Optimization of visual odometry based on uncertainty analysis[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(9): 1572-1579.
[10] MA Li-sha, ZHOU Wen-hui, GONG Xiao-jin, LIU Ji-lin. Motion constrained generalized Field D* path planning[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(8): 1546-1552.
[11] LU Dan-hui, ZHOU Wen-hui, GONG Xiao-jin, LIU Ji-lin. Decoupled mobile robot motion estimation based on fusion of
visual and inertial measurement unit
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2012, 46(6): 1021-1026.
[12] XU Jin, SHEN Min-yi, YANG Li, WANG Wei-qiang, LIU Ji-lin. Binocular bundle adjustment based localization
and terrain stitching for robot
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2011, 45(7): 1141-1146.
[13] CHEN Jia-qian, LIUYu-tian, HE Yan, JIANG Jing-ping. Novel dynamic mapping method based on occupancy grid
model and sample sets
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2011, 45(5): 794-798.
[14] CHEN Jia-Gan, HE Yan, JIANG Jing-Ping. Improved FastSLAM algorithm based on importance weight smoothing[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2010, 44(8): 1454-1459.
[15] LU Ren-Quan, WEI Jiang, XUE An-Ke. State estimation of network control system based on
linear quantization
[J]. JOURNAL OF ZHEJIANG UNIVERSITY (ENGINEERING SCIENCE), 2010, 44(7): 1400-1405.